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COMPUTATIONALLY EFFICIENT MEANS FOR OPTIMAL 
CONTROL WITH CONTROL CONSTRAINTS 

[1 ] This application claims priority to U.S. Provisional Application Serial No. 60/271 ,792, 

Filed February 27, 2001. 

BACKGROUND OF THE INVENTION 

[2] Field of the Invention 

This invention relates to optimal control of a system. More particularly, this invention 
relates to active vibration and active sound control systems for the interior of helicopters. 
[3] Background Art 

Conventional active control systems consist of a number of sensors that measure the 
ambient variables of interest (e.g. sound or vibration), a number of actuators capable of 
generating an effect on these variables (e.g. by producing sound or vibration), and a computer 
which processes the information received from the sensors and sends commands to the actuators 
so as to reduce the amplitude of the sensor signals. The control algorithm is the scheme by which 
the decisions are made as to what commands to the actuators are appropriate. 
[4] A problem may arise in such a control scheme when the control decision yields a 

Y\ command that exceeds the physical capabilities of the system, for example, if the command to an 

actuator exceeds the actuator's physical limits. 
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SUMMARY OF THE INVENTION 

[5] The present invention utilizes a varying control weighting to provide improved 

performance while avoiding saturation of the actuators. For a least-squares or quadratic 
performance index, one typically includes a weighting on the control amplitudes to avoid actuator 
saturation. However, a constant weighting that is sufficient to ensure that no actuator ever 
saturates results in less than optimal performance. This invention therefore modifies the control 
weighting to ensure that the maximum possible performance is always obtained subject to the 
saturation constraints. 
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In the present invention, the ambient vibration is measured by a plurality of sensors. A 
plurality of command signals are generated over time based upon the measured vibration and 
based upon a control weighting. By varying the control weighting over time, the maximum 
possible performance is always obtained subject to the saturation constraints. The control 
weighting maybe varied based upon the magnitude of the command signals. 

BRIEF DESCRIPTION OF THE FIGURES 

FIG. 1 shows a block diagram of the noise control system of the present invention. 
FIG. 2 shows a vehicle in which the present invention may be used. 

DETAILED DESCRIPTION 

Control systems consist of a number of sensors which measure ambient vibration (or 
sound), actuators capable of generating vibration at the sensor locations, and a computer which 
processes information received from the sensors and sends commands to the actuators which 
generate a vibration field to cancel ambient vibration (generated, for example by a disturbing 
force at the helicopter rotor). The control algorithm is the scheme by which the decisions are 
made as to what the appropriate commands to the actuators are. 

FIG. 1 shows a block diagram 10 of an active control system. The system comprises a 
structure 102, the response of which is to be controlled, sensors 128, filter 112, control unit 106 
and actuators (which could be force generators) 104. A disturbance source 103 produces 
undesired response of the structure 102. In a helicopter, for example, the undesired disturbances 
are typically due to vibratory aerodynamic loading of rotor blades, gear clash, or other source of 
vibrational noise. A plurality of sensors 1 28(a)... (n) (where n is any suitable number) measure 
the ambient variables of interest (e.g. sound or vibration). The sensors (generally 128) are 
typically microphones or accelerometers, or virtually any suitable sensors. Sensors 128 generate 
an electrical signal that corresponds to sensed sound or vibration. The electrical signals are 
transmitted to filter 112 via an associated interconnector 144(a). ..(n) (generally 144). 
Interconnector 1 44 is typically wires or wireless transmission means, as known to those skilled in 
the art. 
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Filter 1 1 2 receives the sensed vibration signals from sensors 1 28 and performs filtering on 
the signals, eliminating information that is not relevant to vibration or sound control. The output 
from the filter 1 12 is transmitted to control unit 106 via interconnector 142 respectively. The 
control circuit 106 generates control signals that control force generators 104(a). ..(n). 

A plurality offeree generators 104(a).. .(n) (where n is any suitable number) are used to 
generate a force capable of affecting the sensed variables (e.g. by producing sound or vibration). 
Force generators 1 04(a)... (n) (generally 104) are typically speakers, shakers, or virtually any 
suitable actuators. Force actuators 104 receive commands from the control unit 106 via 
interconnector 134 and output a force, as shown by lines 132(a). ..(n) to compensate for the 
sensed vibration or sound produced by vibration or sound source 103. 

The control unit 106 is typically a processing module, such as a microprocessor, with 
processing capabilities. Control unit 1 06 stores control algorithms control memory 105, or other 
suitable memory location. Memory module 105 is, for example, RAM, ROM, DVD, CD, a hard 
drive, or other electronic, optical, magnetic, or any other computer readable medium onto which 
is stored the control algorithms described herein. The control algorithms are the scheme by which 
the decisions are made as to what commands to the actuators 104 are appropriate. 

For a least-squares or quadratic performance index, one typically includes a weighting on 
the control amplitudes to avoid actuator saturation. However, a constant weighting that is 
sufficient to ensure that no actuator ever saturates results in less than optimal performance. This 
invention therefore modifies the control weighting to ensure that the maximum possible 
performance is always obtained subject to the saturation constraints. This is useful in the 
reduction of gear-mesh noise within a helicopter cabin. 

For tonal control problems, the computation can be performed at an update rate lower 
than the sensor sampling rate as described in the copending application entitled "Computationally 
Efficient Means for Active Control of Tonal Sound or Vibration," which is commonly assigned. 
This approach involves demodulating the sensor signals so that the desired information is near 
DC (zero frequency), performing the control computation, and remodulating the control 
commands to obtain the desired output to the actuators. The control computations are therefore 
performed on the sine and cosine components at the frequency of interest for each sensor signal. 
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These can be represented as a complex variable where the real part is equal to the cosine term, 
and the imaginary part is equal to the sine term. The same control algorithm can therefore be 
used for either low frequency disturbances or tonal disturbances, provided that complex notation 
is used. The approach will be described for such a demodulated tonal problem, but is equally 
applicable to low frequency disturbances. 
[16] The number of sensors is given by n s and the number of actuators n a . The complex 

harmonic estimator variables that are calculated from the measurements of noise or vibration 
level can be assembled into a vector of length n s denoted z k at each sample time k. The control 
commands generated by the control algorithm can likewise be assembled into a vector of length 
n a denoted u k . The commands sent to the actuators are generated by multiplying the real and 
imaginary parts of this vector by the cosine and sine of the desired frequency. 
U| [17] In the narrow bandwidth required for control about each tone, the transfer function 




between actuators and sensors is roughly constant, and thus, the system can be modeled as a 
single quasi-steady complex transfer function matrix, denoted T. This matrix of dimension n s by 
n a describes the relationship between a change in control command and the resulting change in 
the harmonic estimate of the sensor measurements, that is, Az k = T Au k . For notational 
simplicity, define y k = Az k , and v k = Au k . The complex values of the elements of T are 
determined by the physical characteristics of the system (including actuator dynamics, the 
structure and/or acoustic cavity, and anti-aliasing and reconstruction filters) so that Ty is the 
response at the reference frequency of sensor i due to a unit command at the reference frequency 
on actuator j. Many algorithms may be used for making control decisions based on this model. 



[18] 



The control law is derived to minimize a quadratic performance index 



J = z H W z z + u H W u u + v H W 5u v 



where W z , W u and W 6u are weighting matrices that are typically diagonal on the sensors, control 
inputs, and rate of change of control inputs respectively. A larger control weighting on an 
actuator will result in a control solution with smaller amplitude for that actuator. 



[19] 



Solving for the control which minimizes J yields: 



u k +i = u k - Y k (W u u k + T k H W z z k ) 



where 
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[20] Solving for the steady state control (uk+i = Uk) yields 

u =-(T H W z T + WJ 1 T H W Z z 0 
[21] The matrix Y determines the rate of convergence of different directions in the control 

space, but does not affect the steady state solution. In the following equation, the step size 
multiplier (3<1 provides control over the convergence rate of the algorithm. A value of 
approximately P=0.1 maybe used, for example. 

u k+ i = u k - PY k (W u u k + T k H W z z k ) 
[22] This equation corresponds to a recursive least-squares (RLS) control law. A least mean 

square (LMS) gradient approach could also be used, leading to a similar equation for Uk+i but 
with Y = I instead. For poorly conditioned T matrices, the equalization of convergence rates for 
Q different directions that is obtained with the RLS approach is critical. Decreasing the control 

weighting, W u , increases the low frequency gain, and decreasing the weighting on the rate of 
change of control, Wg u , increases the loop cross-over frequency (where frequency refers to the 
i; %j demodulated frequency) . The notation (u t )k will be used to refer to the (demodulated) command 

to the i th actuator at the k th control iteration. 

uf [23] The command to any actuator may not exceed some (typically) fixed value U ma x> 

FU 

f y depending on the range of the D/A (digital to analog converter), amplifier limits, or actuation 

% ! limits. This maximum value may be different for different actuators. If the desired command to 

fy an actuator (ui) k as determined by the equations above exceeds the maximum allowable for that 

actuator by the ratio R = | (ui) k | / U max? then typically either that one particular actuator command 
is scaled by 1/R, or the entire vector is scaled by 1/R. In many applications the latter yields better 
results. For example, with two force actuators that combine to produce a force and a moment, it 
is preferable to reduce both actuator commands rather than just the saturated actuator, so that a 
significant change in the desired moment is not introduced. However, either of these two 
approaches can lead to a significant loss in performance. 
[24] Typically, the control weighting values are fixed to a predefined value (based on 

experience), and are sometimes scheduled versus operating condition. However, in some 
applications such as using the active noise/vibration control algorithm to minimize helicopter 
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noise and/or vibration, it is very difficult to predetermine control weighting values that provide 
optimal performance over the entire flight envelope. Fixing the control weighting to prevent 
actuator saturation in the worst case condition will, in general, result in sub-optimal performance 
over the remainder of the flight envelope. Furthermore, the value of control weighting which 
results in optimal performance on one day may not yield the same performance on a different 
day, or even later during the same flight (e.g. , due to weight, temperature, or humidity changes). 
Based on the above discussion, it would be desirable to be able to actively vary the control 
weighting values to attempt to find the optimal values for the current operating condition. 

One aspect of the present invention is to introduce a time-varying control weighting. 
Another aspect is to improve the re-scaling of the actuator commands in the event of actuator 
saturation. 

Variable weighting 

The approach used to achieve a time-varying control weighting in the noise and vibration 
control algorithm, denoted as variable control weighting, is as follows. When the code is 
initialized, the control weightings are set to some initial conservative values. As the control 
feedback loop converges to a steady state solution, the algorithm slowly varies the control 
weighting on a channel-by-channel basis until optimal performance is achieved. As discussed 
herein, "optimal performance" is defined as achieving the greatest reduction in the magnitude of 
the sensor signals z without saturating any of the actuator channels. In the variable control 
weighting approach, values of the actuator commands are used to actively adjust the control 
weighting values to maximize the reductions in the sensor signals while avoiding saturating any 
of the actuators. In a steady-state condition, the variable control weighting approach actively 
seeks for each actuator channel the smallest value of control weighting required to prevent 
saturation. However, recognizing the fact that a helicopter in flight is never truly in a steady-state 
condition, the variable control weighting approach actively increases the value of the control 
weighting for any actuator channel that saturates. 

The approach used in the noise and vibration control algorithm is to introduce various 
threshold levels, and multiply the control weighting (W u ,0k for each actuator i at each time step k 
by a scalar based on the magnitude of the control command (u t \ computed for that actuator. A 
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table look-up was used for the reduction to practice in helicopter gear-mesh control, however, a 
continuous function could also have been used. An example is given by the table below. 



Magnitude of command 


Scale control weight by 


0< (uOk <-5*u max 


(Wu.Dk-H = 0.999*(W U)i ) k 




(Ui)k 


<.8*u max 


(W u ,0k +1 = l.O*(W U;i )k 


•8*u max < 


(Ui)k 


<-9*u max 


(W u ,i) k+ i=1.08*(W u , i )k 


•9*iw< (Ui)k 


<1.0*u max 


(W IM ) k+ i = 1.20*(W U) iX 


1.0*u max < 


(Ui)k 


(W U)i )k + i = 1.56*(W u ,i)k 



The actual numbers used would differ for each specific application and would depend upon many 
different factors, including the update rate and the control bandwidth. Similarly, in some 
applications, the performance metric of interest is not the rms of all sensors, but rather the worst 
case. For example, with vibration control on a helicopter, the objective is to keep the vibration 
levels at all locations below some specified level. The weighting matrix W z is used to place 
differential weighting on various sensors in which it is desired to produce reductions. In the case 
where there are specific maximum allowable sensor signal magnitudes to satisfy some predefined 
specification, such as a maximum vibration level in the case of AVC, the relative values of the 
elements of W z can be actively adjusted such that all sensors are below their maximum allowable 
values. The relative values in the (typically diagonal) W z matrix are adjusted such that the trace 
of the matrix remains unchanged but the element corresponding to the sensor which is above the 
desired specification is increased. This is done iteratively until all are below the desired 
specification. 

Actuator scaling: 

Conventional approaches to re-scaling the actuator command to avoid saturation result in 
less than optimal performance. The ideal approach is to modify the control weighting for the 
actuators (one or more) with the unallowable commands so that the new commands for those 
actuators are exactly at the limits. The invention described here accomplishes this ideal 

The nominal updated control step is given by 

uw = u k - P(T k H W z T k + W u + Wg-'CWuUk + T k H W z z k ) 
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If the i th actuator command computed from this equation exceeds the allowable command 
Umax (which may be different for different actuators), then a modified control step jjL k +i that 
satisfies | (i(i)k+i I = u max can be computed in a computationally efficient manner from jj, k +i by 
substituting a new control weighting given by W u + ae^i into the control update equation. The 
notation u(i)k indicates the i th element of the vector a at time step k. The vector Q{ denotes a 
vector with all zero entries except for unity in the i th entry, so that the new control weighting 
matrix differs from the original matrix only in the i A diagonal entry. If there are multiple 
actuators at saturation (L>1), then additional terms are added to W u . 

Solving for |Uk+i for each actuator channel j yields 

MtiVi =u()Vi " YQ,i)a(^i) k+ i - (1-P)u(i) k ) 

The scalar Y(j,i) refers to the (j 5 i) th element of the matrix Y defined earlier. For L>1 , the 
same equation holds with a being a real diagonal matrix of additional control weights, i 
representing a vector of indices corresponding to the saturated actuators, and Y(j,i) a lxL vector. 
From this equation, then given a, ji(i) k +i can be computed. From this, the remaining elements of 
(ik+i can be computed. The additional L control weightings on the i th channels, a, and the L 
complex variables |x(j)k+i are the solution of the L complex equations above along with the L real 
constraint equations that | I = u max . This can be solved in a variety of methods. 

In the case of a single unallowable command, a is the solution to the following scalar 
quadratic equation where y = Y(i,i): 

a(ay) 2 + 2b(ay) + c = 0 

where 

a = (l-(3) 2 |u(i) k | 2 -u max 2 
b = (l-p)[u(i) k+1 *u(i) k + u(i)k*u(i) k+ i]/2 - u max 2 

C = I U(i) k+ i | 2 - Umax 2 

Note a < 0, since the command at k th step can't exceed saturation and c>0, since by 
presumption the command exceeds saturation. Therefore, regardless of the sign of b, there is a 
unique, real, positive solution a corresponding to the control weight for which the actuator with 
the nominal command above saturation would instead be exactly at saturation. If the new 
actuator command vector includes any actuators that exceed saturation, the approach can be 
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applied again in an iterative fashion. However, there is no guarantee that this process will 
converge. Therefore, since most of the benefit will accrue from the first or second use of this 
approach, the best compromise is to return to a simpler scaling of the command vector at some 
point if there are remaining actuator commands exceeding saturation. As an aside, also note that 
repeating the process for a second actuator would require re-computing the matrix Y with the 
new control weighting from the first iteration. A similar approach to that described here could be 
derived where several actuators were considered simultaneously; this would result in a set of 
coupled equations for the new control weightings. 

The scaling formulation described herein can be used in conjunction with the previously 
described variable control weighting approach. The final line of the table given in the variable 
control weighting section is modified to use the updated control weighting based on a. This 
approach results in optimal performance in the presence of actuator saturations. Without this 
additional modification, the variable control weighting described earlier will eventually converge 
to the optimal performance solution, however, the convergence maybe poor. Note that if none of 
the actuators saturate in any conditions, then the actuators have more authority than they need. 
Hence, if the actuators must be designed so as to never saturate in order to ensure good 
performance, then the overall cost and weight of the system will be excessive. 

An alternate approach to scaling the control commands if one of them exceeds the 
saturation value is also possible. This alternate approach results in performance that is close to 
the optimal solution described above, although it constrains the control command for the 
saturated actuator more than is necessary. This approach involves scaling back the single 
command, computing the residual noise introduced by doing so, and computing an additional Au 
for the remaining actuators to cancel this residual noise. This last step uses a large control rate 
weighting on the saturated actuator so that the additional Au for that actuator is zero. 

With the first approach (suggested above), the appropriate control weight for that actuator 
is computed and can be used in the next step. Also, for large n a , the computations required for 
the approach described below are substantially more than those required for the first approach. 
However, the second approach is guaranteed to converge if there are multiple actuator 
saturations. Therefore, the most appropriate algorithm for a particular application depends on the 
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number of actuators, the computation available, and the extent to which multiple actuators are 
frequently operating at their saturation limits. The second approach, described below, is 
described in more detail and claimed in copending U.S. Application Serial Number 
, filed , and also claims prior to U.S. Serial Number 60/271,792. 

Actuator Truncation Scheme 

This approach to limiting the actuator commands guarantees convergence in n a or less 
steps to a set of actuator commands which are at or below saturation. A nominal updated control 
step is given by: 

u k+1 = u k - P(T k H WzT k 4- W u + W* f l (W u Uk + T k H W z z k ) 

If the i th actuator command computed from this equation exceeds the allowable command 
Umax (which may be different for different actuators), then a modified control update |i k +i that 
satisfies | I = u max is computed from u k+ i by scaling u(i) k +i by the ratio u max / 1 u(i) k+ i | 

while all other elements of u k+ i are held fixed. Then a revised control update u* k +i is computed 
from the following control update equation: 

u Vi = ii k+1 - (T k H W 2 T k + W* 5u + je i e i T )- 1 (T k H W z T k (^i k+1 - u k+1 )) 

with 

W* 5u = W au 

where y is "a large number" (i.e., on the order of 10 6 times larger than the magnitude of a typical 
element of W§ u .) The vector e* denotes a vector with all zero entries except for unity in the i th 
entry, so that the new control rate weighting matrix differs from the original matrix only in the i 
diagonal entry. The addition of the term ye^ 1 to the i th element of the control rate weighting 
matrix W§ u prevents the i th element of ji k+ i from being altered by the above control update 
equation, i.e. it is guaranteed that u*(i) k+ i = |x(i) k +i 

The above procedure is repeated iteratively for each saturated channel (one channel at a 
time) until no elements of the control update exceed their respective saturation values. This 
iterative procedure is guaranteed to converge in no more than n a steps since once an actuator 
channel has reached saturation, that channel's command is held fixed at saturation until the next 
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control update cycle. Once this procedure has been completed, then u^+i = u*k+i is defined as the 
control update for the current cycle. 

FIG. 2 shows a perspective view 20 of a vehicle 1 1 8 in which the present invention can be 
used. Vehicle 118, which is typically a helicopter, has rotor blades 119 (a).. .(d). Gearbox 
housing 1 10 is mounted at an upper portion of vehicle 1 1 8. Gearbox mounting feet 140 (a). ..(c) 
(generally 140) provide a mechanism for affixing gearbox housing 1 1 0 to vehicle airframe 142. 
Sensors 128(a) through (d) (generally 128) are used to sense acoustic vibration produced by the 
vehicle, which can be from the rotorblades 1 19 or the gearbox housing 110. Although only four 
sensors are shown, there are typically any suitable number of sensors necessary to provide 
sufficient feedback to the controller (not shown). The sensors 128 maybe mounted in the vehicle 
cabin, on the gearbox mounting feet 140, or to the airframe 142, or to another location on the 
vehicle 118 that enables vehicle vibrations or acoustic noise to be sensed. Sensors 128 are 
typically microphones, accelerometers or other sensing devices that are capable of sensing 
vibration produced by gear clash from the gearbox 1 10 and generating a signal as a function of 
the sensed vibration. These sensors generate electrical signals (voltages) that are proportional to 
the local noise or vibration. 

In accordance with the provisions of the patent statutes and jurisprudence, exemplary 
configurations described above are considered to represent a preferred embodiment of the 
invention. However, it should be noted that the invention can be practiced otherwise than as 
specifically illustrated and described without departing from its spirit or scope. Note that 
alphanumeric labels on method steps are for clarifying references in dependent claims and unless 
otherwise specified do not require a specific sequence in which the steps are to be performed. 
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